Topological data analysis (TDA) is a branch of computational mathematics, bridging algebraic topology and data science, that provides compact, noise-robust representations of complex structures. Deep neural networks (DNNs) learn millions of parameters associated with a series of transformations defined by the model architecture, resulting in high-dimensional, difficult-to-interpret internal representations of input data. As DNNs become more ubiquitous across multiple sectors of our society, there is increasing recognition that mathematical methods are needed to aid analysts, researchers, and practitioners in understanding and interpreting how these models' internal representations relate to the final classification. In this paper, we apply cutting edge techniques from TDA with the goal of gaining insight into the interpretability of convolutional neural networks used for image classification. We use two common TDA approaches to explore several methods for modeling hidden-layer activations as high-dimensional point clouds, and provide experimental evidence that these point clouds capture valuable structural information about the model's process. First, we demonstrate that a distance metric based on persistent homology can be used to quantify meaningful differences between layers, and we discuss these distances in the broader context of existing representational similarity metrics for neural network interpretability. Second, we show that a mapper graph can provide semantic insight into how these models organize hierarchical class knowledge at each layer. These observations demonstrate that TDA is a useful tool to help deep learning practitioners unlock the hidden structures of their models.

用于图像分类的深神经网络通常使用卷积过滤器来提取区分特征，然后再将其传递到线性分类器。大多数可解释性文献都集中在为卷积过滤器提供语义含义，以解释模型的推理过程，并确认其从输入域中使用相关信息。可以通过使用单数值分解分解其重量矩阵来研究完全连接的层，实际上研究每个矩阵中的行之间的相关性以发现地图的动力学。在这项工作中，我们为卷积层的重量张量定义了一个奇异的值分解，该分解器提供了对过滤器之间的相关性的类似理解，从而揭示了卷积图的动力学。我们使用随机矩阵理论中的最新结果来验证我们的定义。通过在图像分类网络的线性层上应用分解，我们建议一个框架，可以使用HyperGraphs应用可解释性方法来模型类别分离。我们没有寻找激活来解释网络，而是使用每个线性层具有最大相应奇异值的奇异向量来识别对网络最重要的特征。我们用示例说明了我们的方法，并介绍了本研究使用的分析工具DeepDataProfiler库。

Abstractive dialogue summarization has long been viewed as an important standalone task in natural language processing, but no previous work has explored the possibility of whether abstractive dialogue summarization can also be used as a means to boost an NLP system's performance on other important dialogue comprehension tasks. In this paper, we propose a novel type of dialogue summarization task - STRUctured DiaLoguE Summarization - that can help pre-trained language models to better understand dialogues and improve their performance on important dialogue comprehension tasks. We further collect human annotations of STRUDEL summaries over 400 dialogues and introduce a new STRUDEL dialogue comprehension modeling framework that integrates STRUDEL into a graph-neural-network-based dialogue reasoning module over transformer encoder language models to improve their dialogue comprehension abilities. In our empirical experiments on two important downstream dialogue comprehension tasks - dialogue question answering and dialogue response prediction - we show that our STRUDEL dialogue comprehension model can significantly improve the dialogue comprehension performance of transformer encoder language models.

Feature acquisition algorithms address the problem of acquiring informative features while balancing the costs of acquisition to improve the learning performances of ML models. Previous approaches have focused on calculating the expected utility values of features to determine the acquisition sequences. Other approaches formulated the problem as a Markov Decision Process (MDP) and applied reinforcement learning based algorithms. In comparison to previous approaches, we focus on 1) formulating the feature acquisition problem as a MDP and applying Monte Carlo Tree Search, 2) calculating the intermediary rewards for each acquisition step based on model improvements and acquisition costs and 3) simultaneously optimizing model improvement and acquisition costs with multi-objective Monte Carlo Tree Search. With Proximal Policy Optimization and Deep Q-Network algorithms as benchmark, we show the effectiveness of our proposed approach with experimental study.

Social media has been one of the main information consumption sources for the public, allowing people to seek and spread information more quickly and easily. However, the rise of various social media platforms also enables the proliferation of online misinformation. In particular, misinformation in the health domain has significant impacts on our society such as the COVID-19 infodemic. Therefore, health misinformation in social media has become an emerging research direction that attracts increasing attention from researchers of different disciplines. Compared to misinformation in other domains, the key differences of health misinformation include the potential of causing actual harm to humans' bodies and even lives, the hardness to identify for normal people, and the deep connection with medical science. In addition, health misinformation on social media has distinct characteristics from conventional channels such as television on multiple dimensions including the generation, dissemination, and consumption paradigms. Because of the uniqueness and importance of combating health misinformation in social media, we conduct this survey to further facilitate interdisciplinary research on this problem. In this survey, we present a comprehensive review of existing research about online health misinformation in different disciplines. Furthermore, we also systematically organize the related literature from three perspectives: characterization, detection, and intervention. Lastly, we conduct a deep discussion on the pressing open issues of combating health misinformation in social media and provide future directions for multidisciplinary researchers.

自我监督学习（SSL）通过利用不需要标签的借口任务来学习有用的归纳偏见。 SSL的未标记性质使得对整个幻灯片组织病理学图像（WSIS）尤为重要，在该图片级的人类注释很难。蒙面自动编码器（MAE）是一种适合数字病理学的SSL方法，因为它不需要阴性采样，并且几乎不需要数据增加。但是，自然图像和数字病理图像之间的域移动需要进一步研究贴片级WSIS的MA​​E。在本文中，我们研究了组织病理学中MAE的几种设计选择。此外，我们引入了一个多模式MAE（MMAE），该MAE（MMAE）利用了苏木精和曙红（H＆E）染色的WSI的特定组成性。我们在公共补丁级数据集NCT-CRC-HE-100K上进行了实验。结果表明，MMAE架构的表现优于监督基线和其他最先进的SSL技术，用于八类组织表型任务，仅利用100个标记的样品进行微调。我们的代码可从https://github.com/wisdomikezogwo/mmae_pathology获得

人们对出于各种目的的人交谈的综合视频图像产生了浓厚的兴趣，包括娱乐，交流，培训和广告。随着深层伪造的模型的发展，合成视频图像很快将在视觉上与自然捕获视频的肉眼无法区分。此外，许多方法正在继续改进，以避免更谨慎，法医视觉分析。通过使用面部木偶来制作一些深层的虚假视频，该视频通过演员的动作直接控制合成图像的头部和面部，使演员可以将其“木偶”“木偶”“木偶”“木偶”“木偶”相同。在本文中，我们解决了一个问题，即是否可以通过控制扬声器的视觉外观，但从另一个来源转移行为信号来将一个人的动作与原始扬声器区分开。我们通过比较综合图像来进行研究：1）源自另一个人说不同话语的人，2）起源于同一人说的话不同，3）源自另一个人说相同的话语。我们的研究表明，在所有三种情况下，合成视频都比原始源视频不那么真实和吸引力。我们的结果表明，可以从一个人的动作中检测到​​与视觉外观分开的行为签名，并且可以使用这种行为签名来区分深处的伪造与正确捕获的视频。

Facebook和Twitter等社交媒体平台上的在线形象已成为互联网用户的日常习惯。尽管平台为用户提供了大量服务，但用户仍遭受网络欺凌的困扰，这进一步导致了精神虐待，并可能升级以对个人或目标群体造成身体伤害。在本文中，我们使用相关的阿拉伯语Twitter数据集将其提交给阿拉伯仇恨言论2022共享任务研讨会（OSACT5 2022）。共享任务由3个子任务组成，子任务A的重点是检测该推文是否令人反感。然后，对于进攻性推文，子任务B专注于检测该推文是否是仇恨言论。最后，对于仇恨言论推文，子任务C的重点是检测六个不同类别中的细粒度仇恨言论。变压器模型证明了它们在分类任务方面的效率，但是在小型或不平衡数据集中进行微调时的合适问题。我们通过研究多个培训范式（例如对比学习和多任务学习以及分类微调）以及我们前5名表演者的合奏来克服这一限制。我们提出的解决方案分别在子任务A，B和C中分别实现了0.841、0.817和0.476宏F1平均。

我们提出了一个使用脑MRI的阿尔茨海默氏病（AD）检测的新型框架。该框架从称为脑感知替代品（BAR）的数据增强方法开始，该方法利用标准的脑部分割来替代与随机挑选的MRI锚固MRI中的医学相关的3D脑区域，以创建合成样品。地面真相“硬”标签也根据替换比的不同，以创建“软”标签。与其他基于混合的方法（例如CutMix）相比，BAR可产生各种各样的逼真的合成MRI，具有较高局部变异性。在酒吧之上，我们建议使用具有软标签能力的监督对比损失，旨在了解表示形式的相对相似性，这些相似性反映了使用我们的软标签的合成MRI的混合方式。这样，我们就不会充分耗尽硬标签的熵能力，因为我们只使用它们来通过bar创建软标签和合成MRI。我们表明，使用用于创建合成样品的硬质标签的跨凝结损失，可以通过跨凝性损失进行预训练的模型。我们在二进制广告检测任务中验证了框架的性能，以与从划伤的监督培训和最先进的自我监督培训以及微调方法进行验证。然后，我们通过将BAR的个人性能与另一个基于混合的方法CutMix进行了整合，从而评估了BAR的个人性能。我们表明，我们的框架在AD检测任务的精确度和回忆中都产生了卓越的结果。

天然有组织的系统适应内部和外部压力，这似乎一直在下降。想清楚地思考这个想法会激发我们的论文，因此在引言中广泛阐述了这个想法，哲学上有利的受众应该可以广泛地使用。在其余部分中，我们转向更加压缩的类别理论。我们定义了动态组织的单体双重类别$ \ mathbf {org} $，我们提供了$ \ mathbf {org} $的定义 - 富集或“动态”，分类结构 - 例如。动态类别，目录和单体类别 - 我们展示了它们如何实例化激励的哲学思想。我们给出了两个动态分类结构的示例：作为动态奥运会的预测市场和作为动态单体类别的深度学习。